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ABSTRACT 


When  only  a  limited  number  of  simulation  runs  are  available,  it 
is  usually  impossible  to  thoroughly  investigate  all  of  the  factors  under 
consideration.  Often,  though,  it  is  anticipated  that  only  a  small  subset 
of  the  original  factors  is  important.  Accordingly,  it  is  desired  to 
screen  the  factors  in  order  to  help  identify  those  that  do  exert  an 
appreciable  effect  on  the  simulation  response.  IVo-stage  group  screening 
is  one  possible  strategy  that  may  be  used.  However,  a  basic  assumption 
of  this  strategy  is  that  the  directions  of  possible  effects  are  known, 
a  priori.  This  report  examines,  in  the  case  of  zero  error  variance 
(i.e.,  when  the  simulation  response  is  observed  without  random  error), 
the  performance  of  two-stage  group  screening  when  the  assumption  of  known 
directions  is  relaxed. 
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I.  INTRODUCTION 


Many  computer  simulation  studies  involve  a  large  number  of  factors 
(i.e.,  independent  variables),  but  are  limited  in  the  number  of  simulation 
runs  available.  In  these  cases,  a  major  problem  that  a  simulation  user 
faces  is  to  determine  the  effects  of  the  factors  on  the  simulation 
response  (i.e.,  dependent  variable). 

When  only  a  limited  number  of  simulation  runs  are  available,  it  is 
usually  impossible  to  thoroughly  investigate  all  the  factors.  Often,  though, 
it  is  anticipated  that  only  a  small  subset  of  the  many  original  factors  is 
important.  Accordingly,  it  is  desired  to  screen  the  factors  in  order  to 
help  identify  the  relatively  few  that  do  exert  an  appreciable  effect  on  the 
simulation  response.  Such  experiments  are  called  factor  screening  experiments, 
and  the  problem  of  experimentation  to  determine  the  size  and  the  composition 
of  the  subset  of  important  factors  is  called  the  factor  screening  problem. 

Although  this  report  places  the  factor  screening  problem  in  a  computer 
simulation  context,  this  type  of  problem  can  arise  in  practically  any  field 
of  scientific  research  in  which  conventional  designs  are  prohibited  due  to 
the  number  of  experimental  observations  they  require.  Therefore,  the  results 
of  this  report  could,  if  desired,  be  generalized  to  embrace  a  wider  experi¬ 
mental  framework  or  application. 

For  the  purpose  of  discussion,  define  as  active  any  factor  which  produces 
a  nonzero  change  in  the  mean  simulation  response.  Hence,  every  factor  can  be 
classified  as  an  active  or  an  inactive  factor.  In  general,  therefore,  the 
basic  objective  of  any  factor  screening  strategy  is  to  efficiently  and  effec¬ 
tively  classify  the  factors  under  investigation.  Of  course,  these  notions 


will  need  to  be  made  precise  in  order  to  objectively  evaluate  the  perfor¬ 
mance  of  a  screening  strategy. 

Unfortunately,  to  date,  no  specific  methodology  has  been  developed  to 
adequately  resolve  the  factor  screening  problem,  although  a  number  of  general 
suggestions  have  been  made  [e.g.,  Hunter  and  Naylor  (1970),  Jacoby  and 
Harrison  (1962),  Kleijnen  (1945),  Smith  (1973),  Montgomery  (1979),  Smith 
and  Mauro  (1980)].  Despite  these  suggestions,  there  remains  a  lack  of 
analytical  and  empirical  results  with  which  to  systematically  analyze  the 
factor  screening  problem. 


II.  BACKGROUND 


Smith  and  Mauro  (1980)  suggested  two  screening  strategies  for 
further  research  and  also  suggested  a  performance  measure  to  evaluate 
them  (or  any  other  strategy) .  The  two  screening  strategies  identified 
as  warranting  more  detailed  investigation  were  the  two-stage  group  screening 
method  and  a  random  balance/Plackett-Burman  design  two-stage  combination 
strategy.  Both  of  these  strategies  are  intended  for  use  in  situations  in 
which  the  available  number  of  computer  runs  is  less  than  the  number  of 
factors  to  be  screened. 

A  basic  assumption,  however,  in  the  group  screening  strategy  is  that 
the  directions  of  possible  effects  are  known,  a  priori.  Historically 
[Watson  (1961),  Kleijnen  (1975)],  the  effect  of  this  assumption  on  per¬ 
formance  has  been  regarded  with  little  concern.  The  primary  objective  of 
this  report  is  to  explicitly  examine,  in  the  case  of  zero  error  variance 
(i.e.,  when  the  simulation  response  is  observed  without  random  error),  the 
performance  of  two-stage  group  screening  when  the  assumption  of  known 
directions  is  relaxed.  The  results  of  this  analysis  should  help  determine 
whether  group  screening  can  be  effectively  used  even  when  all  the  directions 
of  potential  effects  are  not  known  (or  are  incorrectly  specified). 

Initially,  the  following  factor  screening  model  will  be  assumed  to 
underlie  the  simulation  responses.  In  section  IV  two  further  conditions 
will  be  Imposed  on  this  model.  The  factor  screening  model  is 

yi  •  eo  +  ^  Vij  +  v  <2-1) 
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where 

th 

(1)  is  the  response  of  the  i  simulation  run, 

(2)  K  is  the  total  number  of  factors  to  be  screened,  each  of  which 
is  at  two  levels, 


(3) 


is  +1  or  -1  depending  on  the  level  of  the  factor  for 
the  i*"*1  simulation  run. 


(4)  13^  is  the  (linear)  effect  of  the  j  factor, 


and  (5)  the  error  terms,  e^,  are  independent  with  common  distribution 


III.  GROUP  SCREENING 


In  the  first  stage  of  the  two-stage  group  screening  procedure, 
originally  proposed  by  Watson  (1961) ,  group-factors  are  formed  by 
subdividing  the  original  factors  into  groups  of  (roughly)  equal  size. 

The  group  factors  are  considered  as  single  factors  and  are  examined  in 
a  Plackett-Burman  design.^"  Group-factor  levels  are  defined  by  equating 
the  levels  of  component  factors  to  the  group-factor  level.  In  the 
second  stage  of  the  procedure,  the  individual  factors  which  comprise 
the  significant  group-factors  are  also  examined  in  a  Plackett-Burman 
(1946)  design. 

Since  the  grouping  procedure  induces  complete  confounding  among  the 
factors  within  a  group,  the  second  stage  can  be  regarded  as  a  follow-up 
experiment  that  separates  the  effects  of  factors  which  comprise  the 
significant  group-factors.  A  brief  description  of  the  two-stage  group 
screening  procedure  is  outlined  in  the  following  paragraphs. 


A.  STAGE  ONE 

The  initial  step  is  to  randomly  partition  the  K  factors  into  groups 
of  size  g.  To  allow  for  general  g,  denote  this  particular  variation  as  the 
GSg  strategy.  If  K  is  not  a  multiple  of  g,  then  the  group  sizes  should  be 
taken  as  "evenly"  as  possible.  For  example,  if  K  ■  46  and  g  -  3,  the  par¬ 
tition  would  consist  of  14  groups  of  size  3  and  1  group  of  size  4,  for  a 

- 

Plackett-Burman  designs  are  two-level,  orthogonal  fractional  factorial 
designs  for  studying  up  to  (4m  -  1)  factors  in  4m  runs.  [See  Plackett  and 
Burman  (1946).] 
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total  of  15  groups.  (See  section  VI  for  practical  considerations  in 
factor  partitioning.)  Let  G  denote  the  number  of  groups  into  which  the 
K  factors  are  partitioned. 

Once  the  factors  are  partitioned  into  G  groups,  the  group-factors 
are  systematically  tested  in  a  Plackett-Burman  design  employing  N  runs. 

If  B(x)  denotes  the  smallest  integer  larger  than  x  that  is  a  multiple  of 
four,  then  N  =  B(G).  For  instance,  in  the  above  example,  N  =  B(15)  =  16. 

The  +1  level  of  a  group-factor  is  defined  as  the  level  in  which  all 
factors  within  that  group  are  maintained  at  their  +1  level.  The  -1  level 
of  a  group-factor  is  analogously  defined.  However,  when  specifying  the 
original  factor  levels,  the  level  which  will  produce  the  larger  response 
(if,  in  fact,  the  factor  is  active)  should  be  defined  as  the  +1  level  in 
order  to  prevent  the  possibility  of  group-factor  effect  cancellation.  Thus, 
all  factors  which  are  active  will  have  effects  with  the  same  direction.  As 
mentioned  previously,  it  has  been  assumed  in  the  development  of  two-stage 
group  screening  that  this  can  be  done.  This  report  examines  the  impact  of 
relaxing  this  assumption. 

B.  STAGE  TWO 

Only  the  individual  factors  which  comprise  the  group-factors  determined 
to  have  significant  effects  in  stage  one  are  carried  over  into  this  stage. 
The  factors  reaching  this  stage  are  tested  individually  in  a  Plackett-Burman 
design.  If  s  equals  the  number  of  factors  carried  over,  then  the  required 
number  of  second  stage  runs,  M,  equals  B(s). 
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Any  factor  determined  to  have  a  significant  effect  in  this  stage  is 
classified  as  active.  Any  factor  not  having  a  significant  effect  or  any 
factor  not  even  carried  over  from  stage  one  is  classified  as  an  inactive 


factor.  The  total  number  of  runs,  R,  that  the  two  stages  require  will  equal 


IV.  ADDITIONAL  ASSUMPTIONS  AND  NOTATION 


In  his  development  of  group  screening,  Watson  (1961)  imposed  two 
additional  assumptions  on  the  first-order  model  (2.1)  defined  previously. 
In  addition  to  conditions  (l)-(5),  these  are: 


(6)  all  factors  have,  independently,  the  same  prior  probability, 
p,  of  being  active, 


and  (7)  active  factors  have  the  same  linear  effect,  A  >  0,  i.e., 


e 


j 


{A  ,  if  jth  factor  active 
0  ,  if  j1"*1  factor  inactive. 


A  prerequisite  for  assumption  (7)  is  that  the  directions  of  all 
potential  effects  are  known.  In  this  case,  the  upper  level  (+1)  of  each 
factor  can  be  defined  as  the  level  which  will  lead  to  a  larger  response 
if  the  factor  is  active.  Hence,  the  associated  linear  effect,  g ^ ,  will 
be  nonnegative.  More  importantly,  assumption  (7)  serves  to  insure  against 
possible  cancellation  of  effects  that  may  occur  within  a  group-factor. 

Assumption  (6)  effectively  states  that  the  number  of  active  factors 
is  a  binomial  random  variable  with  parameters  K  and  p.  The  resulting 
model  is,  therefore,  a  type  of  random  effects  model.  However,  in  most 
practical  factor  screening  situations,  a  fixed  effects  model  would  appear 
to  be  the  more  appropriate  model.  In  other  words  it  would  be  assumed  that 
some  fixed  (but  unknown)  number,  k,  of  the  K  factors  are  active. 

It  is  the  purpose  of  this  paper  to  examine,  in  the  case  of  zero  error 


2 

variance  (a  =  0) ,  the  performance  of  two-stage  group  screening  when  the 
assumption  of  known  directions  is  relaxed  and  when  the  random  effects 
model  of  assumption  (6)  is  replaced  with  a  fixed  effects  model.  Thus, 
in  place  of  conditions  (5),  (6),  and  (7),  these  modified  conditions  will 
be  assumed: 

(5')  the  observations  are  observed  without  random  error  (i.e., 
a  =  0), 


(6')  there  are  a  total  of  K  factors  to  be  screened,  k  1  (unknown) 
of  which  are  active  and  (K  -  k)  of  which  are  inactive  (let 
p*  =  k/K), 

and  (7')  all  active  factors  have  the  same  absolute  linear  effect,  A  >  0, 
i.e., 

J  A  ,  if  factor  active 
|  0  ,  if  j**1  factor  inactive. 

Conceptually,  (61)  and  (7')  compare  with  assumptions  (6)  and  (7)  in 
the  following  ways: 


(a)  Assumption  (6)  states  that  whether  or  not  a  factor  will  be  active 

is  a  random  occurrence  in  which  all  factors  have,  independently, 

the  same  prior  probability  of  being  active.  Thus,  k  ~  b(K,  p) 

w 

where  k  denotes  the  number  of  active  factors.  Because  of  the 
w 

symmetry  in  factor  effect  magnitude,  for  a  fixed  K  it  is  the 
number  of  active  factors  and  not  which  particular  factors  are 
active  that  is  the  essential  element  in  formalizing  the  model. 

In  passing  from  (6)  to  (6')  or  from  (6')  to  (6),  assume 
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that  p  *  p*.  Hence,  k^  ~  b(K,  k/K),  from  which  it  follows  that 

E(k  )  *  k.  Therefore,  on  the  average,  the  number  of  active 
w 

factors  corresponding  to  assumptions  (6)  and  (6')  is  the  same. 

(b)  Assumption  (7)  requires  that  the  directions  of  possible  effects 
are  known.  Therefore,  factor  levels  can  be  judiciously  specified 
so  that  all  active  factors  will  have  positive  effects.  Of  course, 
it  is  further  assumed  that  these  effects  are  of  the  same  magni¬ 
tude.  Since  condition  (7*)  requires  only  equal  absolute  effects, 
(7')  relaxes  the  assumption  of  known  directions.  Thus  condition 
(7)  is  actually  a  special  case  of  (7*). 


For  purposes  of  analysis,  it  can  be  assumed  without  loss  of  generality 
that  the  first  k  indexed  factors  are  active  and  the  remaining  (K  -  k)  factors 
are  inactive.  As  a  result  of  (5*),  (6'),  and  (7'),  model  (2.1)  can  be  updated 
and  rewritten  as 


(4.1) 


where  x^  is  +1  depending  on  the  level  specification  of  factor  j  (j  *  1,  2, 

...,  K)  and  1 3.  |  “A  when  1  £  j  £  k.  It  is  implicit  that  3  «•  0  when  j  >  k. 
J  J 

If  the  factor  level  (of  active  factors)  producing  the  larger  response 


is  defined  as  the  +1  level,  then  3j  ■  A  >  0  for  all  1  <_  j  <_  k.  However,  if 
this  arrangement  is  not  followed,  then  a  mixture  of  +A's  will  result  within 


3^,  3^.  To  represent  this  possibility,  let  3.  “  (3^»  3^) '  and 

let  j5(i)  denote  the  case  where  3^»  $2 .  ®i  eac^  ^aa!  “A  and 

3^  each  equal  +A.  Define  _3(0)  -  (A,  A,...,  A)'.  Note  that  j?(0)  represents 
the  case  assumed  in  condition  (7). 
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ASSESSING  PERFORMANCE 


Because  of  the  first-order  structure  of  model  (2.1)  and  because  of 
the  resolution  properties  of  Plackett-Burman  designs,  under  the  assumption 
of  zero  error  variance,  any  factor  reaching  stage  two  of  the  GSg  strategy 
will  be  correctly  classified.  Consequently,  in  the  case  of  zero  error 
variance,  no  inactive  factor  will  be  misclassif ied  in  the  GS^  strategy 
regardless  of  g  or  3. 

However,  this  is  not  necessarily  true  of  the  active  factors.  For 
instance,  in  the  cases  3(0)  and  £(k),  all  active  factors  will  be  correctly 
classified  since  cancellation  of  effects  cannot  occur,  but  in  the  other 
3.(1)  (0  <  i  <  k)  arrangements,  some  active  factors  may  fail  to  reach  the 
second  stage  due  to  cancellation  of  group-factor  effects.  As  an  example, 
suppose  four  active  factors,  a,  b,  c,  and  d,  fall  into  a  particular  group 
along  with  some  inactive  factors.  Suppose  3a  ■  3^  *  A  and  3C  ®  3,j  -A. 

In  this  case,  the  overall  group-factor  effect  will  total  zero.  Thus  factors 
a,  b,  c,  and  d  will  not  reach  stage  two  and  will  consequently  be  classified 
as  inactive  factors. 

Of  Interest,  therefore,  is  the  impact  of  the  possibility  of  active 
factor  cancellation  on  the  performance  of  the  GS^  strategy.  In  order  to 
quantitatively  assess  the  extent  of  this  impact,  some  measure  of  performance 
needs  to  be  defined.  One  possible  approach  to  devising  a  performance 
measure  was  outlined  by  Smith  and  Mauro  (1980).  In  this  development, 
evaluating  performance  is  essentially  reduced  to  balancing  two  separate  and 
conflicting  requirements. 

The  first  of  these  two  requirements  concerns  the  severity  of  factor 


classification  errors  that  may  occur  in  factor  screening.  The  following 
loss  function  was  suggested  for  measuring  this  aspect  of  performance: 


K  K 

L(£)  =  E  w.<5  /  E  w  (5.1) 

j-1  J  J  j=l  i 


where 


6 


1 


if  the  j  factor  is  correctly  identified, 
if  the  j*-*1  factor  is  incorrectly  identified. 


and  w 


j  denotes  the  loss  incurred  if  the  jth  factor  is  misclassif ied. 
For  model  (4.1),  it  is  reasonable  to  let 


Wj 


4k  1  1  j  1  k 
4(K  -  k)  j  >  k  , 


since  this  apportions  one-half  of  the  overall  maximum  loss  to  the  active 
factors  and  the  other  half  to  the  inactive  factors.  Thus,  (5.1)  reduces 
to 


L  ■  t(K  -  k)(k  -  A)  +  k(K  -  k  -  I)]/2k(K  -  k)  (5.2) 

where  A  denotes  the  number  of  active  factors  correctly  identified  and  I 
denotes  the  number  of  inactive  factors  correctly  identified. 

Since  L(0  L  <_  1)  is  random  for  most  screening  strategies,  expected 
loss,  E(L) ,  can  be  used  as  one  basis  for  performance.  The  quantity  [1  -  E(L)J 
is,  therefore,  a  measure  of  the  efficiency  of  a  screening  strategy  for 
classifying  factors.  Classification  efficiency  closer  to  one  (or  expected 
loss  closer  to  zero)  would  indicate  better  performance  on  the  average. 

The  other  aspect  of  performance  discussed  by  Smith  and  Mauro  (1980) 
takes  into  account  the  total  number  of  runs,  R,  that  a  strategy  requires. 
Equation  (5.2)  alone  fails  to  do  this.  Regarding  this  aspect  of  performance, 


Q  =  E(R)/B(K) 


(5.3) 


can  be  used  as  a  measure  of  the  relative  testing  cost  of  a  strategy 
(relative  to  the  runs  required  for  a  Placket t-Burman  design). 

Although  a  smaller  value  of  Q  would  indicate  better  performance  on 
the  average,  it  is  imperative  that  expected  loss  and  relative  testing 
cost  be  considered  jointly  in  assessing  the  overall  performance  of  a 
screening  strategy.  As  an  illustration,  consider  the  strategy  employing 
R  **  0  runs  in  which  all  factors  are  declared  active  (or  inactive).  In 
this  trivial  strategy,  Q  -  0,  but  classification  efficiency  is  only  0.51 

For  any  strategy  having  acceptable  expected  loss  and  relative  testing 
cost,  (5.2)  and  (5.3)  might  then  be  combined  into  some  overall  measure,  say 
H,  to  further  evaluate  and  compare  performance.  For  instance,  let 

H  -  [1  -  E(L)]/Q.  (5.4) 

A  larger  H  would  indicate  better  performance  on  the  average.  Other  pos¬ 
sibilities  for  combining  (5.2)  and  (5.3)  into  an  overall  performance  measure 
are  discussed  in  Smith  and  Mauro  (1980) . 

Since  I  ■  K  -  k  in  the  GS  strategy,  performance  (5.4)  of  the  GS 

g  8 


strategy  given  8U)  is 

defined  and 

denoted 

H  (8(i))  - 

BOO 

k  +  E(A 1 8(i) ) 

g  ~ 

E(R|i(i)) 

2k 

(5.5) 

i 

Although  the  exact  probability  distributions  of  A  and  R  are  intractable 
for  general  j3(i),  their  expected  values  do  admit  to  an  analytical  solution 
(see  Appendix  A).  However,  it  is  necessary  to  asstsM  that  K  is  a  multiple 
i  of  g.  In  cases  where  K  is  not  a  multiple  of  g,  but  the  group  sizes  are 

specified  as  "evenly"  as  possible,  the  expressions  should  provide  reasonable 
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approximations  to  the  actual  moments. 

Since  H „($(!))  ■  H  (j3(k  -  i)),  performance  need  only  be  evaluated 

o  8 

for  0  <_  i  [k/2].  Furthermore,  in  the  case  i  =  0,  E(A|j3(0))  ■  k,  so 
that 

H  (8(0))  -  B(K)/E(R|8(0)).  (5.6) 

8 

Therefore,  the  group  size  that  maximizes  H^(8.(0))  is  equivalent  to  the 
group  size  that  minimizes  E(R|8.(0)). 

In  the  case  of  zero  error  variance,  minimizing  the  expected  total 
number  of  runs  is  precisely  Watson's  condition  for  optimum  group  size 
under  assumptions  (6)  and  (7).  Figure  1  contains  Watson's  (approximate) 
optimum  group  size  as  a  function  of  p  (the  probability  a  factor  is  active) 
in  the  case  of  zero  error  variance. 

Because  the  expected  total  number  of  runs  given  8(0)  will  differ 
under  assumptions  (6)  and  (6')  for  a  given  group  size,  let  Ew(R|j3(0)) 
denote  the  expected  total  number  of  runs  given  8.(0)  under  assumption  (6) . 
It  is  easy  to  show  that  for  a  partition  of  the  K  factors  into  G  groups  of 
sizes  gj,  g2,*..»  ggp  ^(Rl 3.(0) )  is  roughly1 

G  8i 

B(G)  +  K  -  I  g  (1  -  p)  1  +  2.5.  (5.7) 

i-1  1 

If  g  ■  g^  for  all  i,  then  (5.7)  reduces  to  B(G)  +  K[1  -  (1  -  p)8]  +  2.5. 

It  will  be  seen  later  that  (5.7)  with  p  *  p*  agrees  fairly  closely 
with  E(R|8(0)),  although  it  is  typically  slightly  smaller.  Hence,  in 
practice,  Ew(R|j3(0))  can  be  used  as  a  first  approximation  to  E(R|j3(0)). 

I 

This  differs  somewhat  from  Watson's  (1961)  approximation  because  his 
approximation  assumes  N  ■  G  +  1  and  M  ■ s  . 
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Prior  Probability 

P 

Optimum  Group 

Size 

.01 

11 

.02 

8 

.03 

6 

.04 

6 

.05 

5 

.06 

5 

.07 

5 

.08 

4 

.09 

4 

.10 

4 

.12 

4 

.13  -  .30 

3 

1 


Figure  1:  Watson's  approximate  optimum  group  size  as  a 

function  of  p  In  the  case  of  zero  error  variance 
[under  assumptions  (6)  and  (7)]. 


VI.  PERFORMANCE  EVALUATION  OF  THE  GSg  STRATEGY 

The  performance  (5.5)  of  the  GSg(3  <_  g  £  8)  strategy  given  J3(i) 

(0  £  i  <_  [k/2])  was  evaluated  for  the  twelve  specific  cases  of  (K,  k) 
listed  in  Figure  2.  For  each  value  of  K  (60,  120,  and  240)  under  investi¬ 
gation,  four  values  of  k  were  examined.  These  were  determined  by  letting 

k  *  p*K,  where  p*  =  2/60,  3/60,  5/60,  and  8/60. 

The  number  of  groups  into  which  the  K  factors  were  partitioned  for 
the  various  group  sizes  are  displayed  in  Figure  3.  When  K  is  a  multiple 
of  g,  it  is  assumed  that  the  factors  are  partitioned  into  K/g  -  G  groups 

of  size  g.  In  practice,  this  may  or  may  not  be  a  desirable  convention. 

For  instance,  when  K  -  60  and  g  ■  3,  24  first  stage  runs  are  required  to 
test  the  20  group-factors.  This  would  seem  to  be  a  waste  of  four  runs. 

An  alternative  plan  would  be  to  employ  16  groups  of  size  three  and  three 
groups  of  size  four,  for  a  total  of  19  group-factors.  This  partition  would 
require  only  20  first  stage  runs  and  would  have  a  comparable  expected  loss. 

Since  the  formulas  for  E(R)  and  E(A)  in  Appendix  A  assume  that  K  is 
a  multiple  of  g,  such  practical  considerations  in  the  number  of  first 
stage  runs  are  not  incorporated  into  the  computations.  However,  the  potential 
reduction  in  E(R)  for  GS^  strategies  where  these  considerations  are  relevant 
can  be  readily  approximated  by  subtracting  4  from  the  expected  total  number 
of  runs  calculated  when  K  is  assumed  a  multiple  of  g.  In  terms  of  Q,  this 
modification  will  result  in  little  reduction  in  relative  testing  cost  unless 
K  is  small. 

For  each  of  the  twelve  cases,  E(A),  E(R),  E(L),  Q  and  H  were  computed 
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.gure  3:  The 


for  every  GSg  (3  £  g  £  8)  strategy  and  for  each  jJ(i) (0  £  i  £  [k/2]) 
case.  The  complete  output  appears  in  Appendix  B.  The  results  of  this 
analysis  pertaining  to  loss,  relative  testing  cost,  and  performance  are 
summarized  below. 

A.  LOSS 

In  general,  expected  loss  is  smaller  for  a  smaller  group  size. 
Furthermore,  for  any  group  size,  E(L|3(i))  *  0  at  i  =  0  and  increases  to 
a  maximum  value  at  i  ■  [k/2]. 

To  better  understand  what  loss  represents,  it  is  instructive  to 
consider  the  quantity  [1  -  2E(L)].  Recall  that  in  the  GS  strategies, 

O 

E(L)  -  (k  -  E (A) ) /2k,  hence  1  -  2E(L)  “  E(A)/k.  Therefore,  in  this  par¬ 
ticular  case  (model  4.1),  1  -  2E(L)  represents  the  proportion  of  the  active 
factors  that  are  correctly  identified.  Hence,  to  say  that  expected  loss 
increases  is  to  say  that  the  expected  proportion  of  active  factors  that 
are  correctly  identified  decreases  and  at  twice  the  rate.  Note  thet  if 
E(A)/k  is  desired  to  be  greater  than  y,  then  E(L)  must  be  smaller  than 

t 

a  -  on. 

As  a  further  aid,  define  Ec(L)  *  E(L|j3(ck)),  0  £  c  £  1.  The  argument 
c  can  be  Interpreted  as  the  proportion  of  the  active  factors  having  an 
effect  of  -A  .  For  the  moment,  suppose  that  EC(L)  is  a  continuous  function 
in  c.  (Use  linear  interpolation  to  define  E£(L)  when  ck  is  not  an  integer.) 

For  a  fixed  group  size,  note  that  E^(L)  *  0,  0  £  Ec(L)  £  1,  EC(L)  is 
symmetric  about  .5  and  is  an  increasing  function  over  the  interval  0  £  c  £  .5. 
Furthermore,  for  a  fixed  c  >  0  and  g,  EC(L)  increases  as  p*  -  k/K  increases. 
That  is,  given  a  fixed  proportion  of  active  factors  equal  to  -A  ,  expected 
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loss  will  increase  as  the  proportion  of  active  factors  increases.  For 
fixed  p*  and  g,  Ec(L)  is  essentially  independent  of  K,  for  60  £  K  £  240,  at 
least  when  g  is  small.  (See  Appendix  C  for  the  case  p*  =  .05.) 

Figure  4  presents  the  Ec(L)  curves  corresponding  to  p*  ■  .05  and  K  ■  240. 
Curves  could  be  constructed  for  the  other  p*  values  by  using  the  data  given 
in  Appendix  B.  These  curves  are  useful  in  determining  what  combinations 
of  group  size  and  jS(i),  for  a  given  p*,  will  meet  (i.e.,  not  exceed)  a 
prespecified  maximum  tolerated  loss. 

B.  RELATIVE  TESTING  COST 

As  expected,  due  to  the  increasing  chance  of  group-factor  effect 
cancellation,  relative  testing  cost  will  decrease  as  the  proportion  of 
active  factors  having  an  effect  of  -A  increases  from  0Z  to  50Z.  In  terms 
of  group  size,  for  a  fixed  J3(i),  there  is  a  group  size  that  minimizes  Q 
(relative  testing  cost)  such  that  using  a  larger  or  smaller  group  size 
will  only  serve  to  increase  the  testing  cost.  For  an  example,  see  Figure 
5. 

It  Is  interesting,  however,  to  observe  (at  least  for  the  range  of 
parameter  values  considered  here)  that  the  group  size  that  minimizes  Q 
at  j$(0)  also  minimizes  Q  at  the  other  J5(i),  i  >  0,  arrangements.  This 
is  apparent  upon  inspection. 

It  was  also  found  that  equation  (5.7)  with  p  ■  p*  provides  a  reasonable 
approximation  to  E(R|B(0))>  See  Figure  6  for  four  specific  cases.  Further¬ 
more,  as  already  noted,  Q  decreases  as  1  increases  from  0  to  [k/2  ] .  As  a 
first  approximation  to  E(R|£([k/2]))»  an  empirically  derived  formula  can  be 
used.  This  formula,  obtained  by  using  least-squares  applied  to  the  data  in 
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Relative  Testing 


Figure  5:  Relative  testing  cost  as  a  function  of  group  size  for 
the  case  K  -  120,  k  -  10  and  8(3). 


Appendix  B,  is: 


E(R|e<[k/2]))  ®  (a  +  bp*g)E(R|£(0))  s  (a  +  bp*g)Ew(R| 3(0) )  , 

(6.1) 

where  a  »  1.01065  and  b  ■  -0.1426.  See  Figure  6  for  an  illustration  of 
this  approximation. 

C.  PERFORMANCE 

As  might  be  expected,  performance  is  better  for  smaller  p*,  i.e., 
there  is  more  to  be  gained  from  the  group  screening  method  when  the 
proportion  of  active  factors  is  smaller.  It  should  be  emphasised,  however, 
that  for  performance  (5.4)  to  be  meaningful,  both  expected  loss  and  relative 
testing  cost  must  have  "acceptable"  values.  Notwithstanding,  a  primary 
result  of  this  paper  is  that  the  optimal  group  size,  which  maximizes  per¬ 
formance  under  j5(0),  is  also  the  optimal  group  size  under  £5(1)  for  i  >  0. 
Note  that  Hg(3(0))  -  Q  1.  Furthermore,  when  practical  considerations  in 
the  number  of  first  stage  runs  is  taken  into  account  (this  is  not  reflected 
in  the  data  appearing  in  Appendix  B),  optimum  group  size  will  agree  with 
Watson's  optimum  group  size,  setting  p  ■  p*  in  Figure  1,  for  the  case  of 
zero  error  variance. 

In  general,  performance  will  decrease  as  i  (in  3.(1))  increases  from 
0  to  [k/2],  although  typically  the  decrease  is  slight.  Figure  7  illustrates 
this  point  for  the  case  K  ■  120  and  k  -  10.  Other  cases  can  be  constructed 
from  the  data  given  in  Appendix  B. 

In  all,  the  performance  (5.5)  of  the  two-stage  group  method  is  fairly 
insensitive  (i.e.,  no  dramatic  decrease  in  performance)  to  departures  from 
assumption  (7).  However,  it  is  not  entirely  clear  whether  different 
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Parameter  Values  E(R|3(0))  Ew(R|3<0))  E(R[3([k/2]))  (a  +  bp*g)Ew(R| 3(0)) 


Performance 

H(BU» 


Performance  in  the  case  K  -  120  and  k  -  10  for 

g  -  3  and  g  -  6. 


performance  criteria  will  lead  to  a  common  conclusion.  This  is  true, 
perhaps,  of  most  decision-making  problems. 

Although  measure  (5.5)  is  not  altogether  comprehensive  in  evaluating 
the  overall  performance  of  the  group  screening  procedure,  no  other  measure 
would  be  either.  It  must  be  the  decision-maker  (i.e.,  the  potential  user 
of  group  screening)  who  defines  the  most  appropriate  measure  for  the  problem 
under  consideration.  In  any  case,  if  an  overall  performance  measure  is 
desired,  that  measure  must  jointly  consider  expected  loss  and  relative 
testing  cost. 
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VII.  DISCUSSION 


In  experimental  situations  where  the  factor  screening  model  (4.1) 
can  be  assumed,  group  screening  can  offer  a  substantial  savings  in  the 
required  number  of  experimental  runs.  However,  the  possible  effects  of 
this  economy  on  factor  classification  efficiency  [1  -  E(L)]  should  be  realized 
especially  when  the  ratio  of  the  number  of  factors  having  negative 
effects  to  the  number  of  factors  having  positive  effects  is  near  one. 

In  such  cases,  the  risk  of  factor  misclassification  may  not  justify  the 
potential  benefits  in  run  economy. 

This  report  explicitly  takes  into  account  the  impact  of  possible 
group-factor  effect  cancellation  on  testing  cost  and  on  factor  classifi¬ 
cation  errors.  Accordingly,  the  results  of  this  report  can  be  used  as 

a  practical  guide  to  decisions  about  the  possible  use  of  a  group  screen- 

2 

ing  strategy,  at  least  in  the  case  a  -  0. 

For  experimental  situations  not  included  in  the  twelve  cases 
investigated  in  this  report,  testing  cost  and  classification  efficiency 
can  be  determined  from  the  general  formulas  presented  in  Appendix  A.  In 
some  cases,  the  data  in  Appendix  B  could  even  be  extrapolated  to  fit  the 
experimental  conditions. 

Although  in  the  development  presented  here,  |$^|,  1  <  i  <  k,  is 
assumed  equal  to  A  ,  the  results  of  this  case  can  be  partially  extended  to 

a  general  £  ■  (8^,  $2 . 8^)’  vector  of  parameters.  Indeed,  let  J3*(i) 

denote  an  arbitrary  8.  vector  having  i  negative  components  and  (k  -  i) 
positive  components. 
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It  Is  easy  to  see  that 


E(R|g(i))  <  E(R|g*(i))  <  E(R|jS(0))  (7.1) 

and  provided  the  same  loss  function  (5.2)  is  used  in  the  J3*(l)  case 
as  in  the  J3(i)  case,  it  follows  that 

0  -  E(L|g(0))  <  E(L| 8*(i))  <  E(L|3(i)).  (7.2) 

It  should  be  noted  that  equation  (7.2)  may  not  hold  if  a  loss  function 
other  than  (5.2)  is  used  in  the  general  JS  case.  However,  equation  (7.1) 
holds  no  matter  what  loss  function  is  specified. 

Thus,  inequalities  (7.1)  and  (7.2)  can  be  used  to  place  limits  on 
loss  (if  (5.2)  is  appropriate)  and  relative  testing  cost  that  can  occur 
for  an  arbitrary  JJ  vector. 
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APPENDIX  A:  DERIVATIONS 

Suppose  K  B  Gg.  Let  A  denote  the  number  of  active  factors  that 
reach  stage  two.  Let  1  i  <_  k-1,  and  define 

f  1  ,  if  factor  //l  carried  over  to  stage  two 

0  ,  if  factor  <fl  not  carried  over  to  stage  two. 

Since  i  >_  1,  (3^  «  -A  for  the  6(i)  case. 

Now 

E(A|j3(i))  *  iPlc  -  l|£(i>]  +  (k  -  i)Ptc  -  l|j3(k  -  i)] 

-  i{l  -  P[c  «  0|_6(i)]>  +  <k  -  i){l  -  P[c  -  0|3(k  -  i)]}. 

Thus,  it  suffices  to  calculate  P[c  «  0|jS(i)]  for  various  i. 

It  is  not  hard  to  show  that 

Ik  -  l] 

P[c  -  O|0(i)l  -  W(i)/|g  -  lj  , 

min (k-1,  g-1) 
where  W(i)  -  £  n, (i) 

J-l  3 

j  odd 


Let  F  denote  the  number  of  inactive  factors  that  reach  stage  two. 
By  a  similar  argument  to  the  above,  It  follows  that  E(F|j3(i))  ■ 

(K  -  k)(l  -  t) 

where  t  -  Z(i)/  j  g  -  1  ]  , 
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and  m^  (i) 


min(k-l,  g-1) 

Z(i)  =  £  m,(i) 

j=0 

j  even 


i  /k-il / K-k-ll 
j/2  j/2/(g-l-j)  . 


f 


Regarding  the  expected  total  number  of  runs,  E(R)  =  E(N  +  M)  * 
E[B(G)  +  B(s)]  *  B(G)  +  E[B(A  +  F) ] .  Using  the  approximation 
B(x)  ~  x  +  2.5,  E(R)  ~  B(G)  +  E(A)  +  E(F)  +  2.5.  Therefore,  the 
performance  measure  (5.5)  may  be  evaluated  as 


H_(3(i))  =  1"  ,  B(K) 

k  +  E(A|3(i)) 

8  [  B(G)  +  E(A| j3(i) )  +  E(F|£(i))  +  2.5 

2k 
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APPENDIX  B:  DATA 


The  following  pages  contain  the  results  of  the  analytical  calculations 
for  the  twelve  specific  cases  of  (K,  k)  listed  In  Figure  2.  Corresponding 

to  each  value  of  g(3  £  g  £  8)  and  J3(i)(i  ■  0,  1,  2 .  [k/2])  Is  a  block 

of  five  numbers.  The  numbers  within  a  block  are  arranged  as  follows: 

E(A),  the  expected  number  of  active  factors  correctly  identified, 

E(R) ,  the  expected  total  number  of  runs, 

E(L),  the  expected  loss, 

Q,  the  relative  testing  cost 
and  H,  the  performance  measure. 


1(0) 


2.000 

32.40 

g  -  3  0.0 

0.5062 

1.9754 


2.000 

26.  30 

g  -  4  0.0 

0.4109 

2.4338 


2.000 

28.  16 

g  -  5  0.0 

0.4400 

2.2726 


2.000 

25.99 

g  -  6  0.0 

0.4061 

2.4623 


2.000 

27.79 

g  -  7  0.0 

0.4342 

2.3031 


2.000 

25.5* 

g  -  8  0.0 

0.3992 

2.5048 


K  -  60,  k  ■  2, 


1(1) 


1.932 

32.33 

0.0169 

0.50*2 

1.9460 


1.898 
26.  19 
0.0254 
0.4093 
2.3811 


1.864 

28.03 

0.0339 

0.4379 

2.2062 


1.831 
25.  E? 
0.0424 
0.4035 
2.3735 


1.797 
27. 5e 
0.0508 
0.4310 
2.2022 


1.763 
25.31 
0.0593 
0.3955 
2.  3783 


*  -  2/60 
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3(1) 


3(0) 


3.000  2.867 

35.  20  35.00 

g  3  0.0  0.0222 

0.5499  0.5468 

1.8184  1.7881 


3.000  2.804 

29.90  29.50 

g  -  A  0.0  0.0327 

0.4671  0.4610 

2.1407  2.0982 


3.000  2.743 

32.50  31. e6 

g  -  5  0.0  0.0429 

0.5078  0.4S78 

1.9692  1.9228 


3.000  2.684 

31.01  30. C6 

g  -  6  0.0  0.0526 

0.4845  0.4657 

2.0639  2.0169 


3.000  2.628 

33.43  32.12 

g  -  7  0.0  0.0620 

0.5223  0.5C19 

1.9147  1.8688 


3.000  2.575 

31.75  30.05 

g  -  8  0.0  0.0709 

0.4961  0.4695 

2.0157  1.9788 


K  ■  60,  k  ■  3,  p*  ■  3/60 
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0(0) 


0(1) 


5.00C 
<10. 50 

8  -  3  0.0 

0.6328 

1.5802 


5.000 
36.  54 

8  -  *  0.0 

0.5709 

1.7517 


5.000 

90.28 

8-5  o.O 

0.6299 

1.5888 


5.000 

39.76 

8-6  0.0 
0.6212 
1.6098 


5.000 

92.97 

8-7  o.O 

0.6715 

1.9893 


5.000 

91.95 

8-8  0.0 

0,6559 

1.5257 


0(2) 


9.793  9.619 

90.11  39.92 

0.0257  0.0386 

0.6268  0.6238 
1.5599  1.  5912 


9.  635  9.  95  1 

35.80  35.99 

0.0365  0.0599 

0.5599  0.5537 

1-7222  1.7069 


9.539  9.  307 

39.13  38.55 

0.0461  0.0692 

0.6114  0.6024 

1.5602  1.  5450 


4.455  4.  17  5 

38.12  37. 3C 

0.0545  0.0821 

0.5S57  0.5828 

1.5873  1.575C 


4.  382  4.067 

40.81  39.72 

0.06  18  0.0933 

0.6377  C. 6206 
1.4713  1.4609 


4.  320  3.  966 

39.23  37.85 

0.0680  0.  1032 

0.6129  C.5913 

1.5206  1.5166 


K  «  60,  k  -  5,  p*  «  5/60 


-35- 


1(0) 


8.000 

47.75 

g  -  3  0.0 

0.7461 

1.3403 


8.000 
45.  19 

g  -  4  0.0 

0.7061 

1.4163 


8.000 

49.95 

g  -  5  0.0 

0.7804 

1.2813 


8.  000 
50.  10 

g  -  6  0.0 

0.7828 

1.2774 


8(1) 

8(2) 

7.575 

7.27  1 

47.11 

46.66 

0.0266 

0.0456 

0.7361 

0.  72  9  C 

1.  3223 

1.  3092 

7.  4  29 

7.0  15 

44.05 

43.23 

0.0357 

0.0612 

0.6882 

0.6755 

1.40  11 

1.  3897 

7.320 

6.828 

48.25 

47.03 

0.0425 

0.  0732 

0.7539 

0.7348 

1.2701 

1.  2612 

7.  243 

6.686 

47.83 

46.18 

0.0473 

0.082  1 

0.7473 

0.7216 

1.2748 

1.  272 C 

8(3) 

6(4) 

7.  088 

7.C27 

46.38 

46.  29 

0.0570 

0.0608 

0.7247 

0.7233 

1.3012 

1. 2585 

6.  77  3 

6.690 

42.74 

42.57 

0.0767 

0.0819 

0.6678 

0.6652 

1.3826 

1. 3802 

6.  530 

6.430 

46.29 

46.04 

0.0919 

0.0581 

0.7233 

0.7194 

1.2556 

1.  2536 

€.346 

6.231 

45.19 

44.85 

0.1034 

0.  1105 

0.7060 

0. 7008 

1.2699 

1.2692 

8.000 

53.72 

g  -  7  0.0 

0.8393 
1.  1915 


8.000 

52.85 

g  -  8  0.0 

0.8258 

1.2109 


7.  192  6.586 

50.69  48.82 

0.0505  0.0884 

0.7951  0.7626 

1.  1942  1.  195  1 


7.  165  6.  520 

49.51  47.03 

0.0522  0.0925 

0.7736  0.7346 

1.  2251  1.  2350 


6.211  6.C63 

47.56  47.  13 

0.1118  0.1198 

0.7431  0.7364 

1.  1953  1.  1952 


6.  114  5.576 

45.50  44.99 

0.1179  0.  1265 

0.7110  0.7029 

1.2408  1.  2427 


K  -  60,  k  -  8,  p*  -  8/60 


g  *  3 


3(0) 


4.000 
58.  20 
0.0 

0.4693 

2.1306 


4.000 

49.90 

g  -  4  0.0 

0.4024 

2.4849 


4.000 

49.51 

g  -  5  0.0 

0.3993 

2.5046 


4.000 
49.0  2 

g  ■  6  o.O 

0.3953 

2.5295 


4.000 

48.44 

g  -  7  o.O 

0.3907 

2.5598 


4.000 

47.77 

g  M  8  0.0 

0.3853 

2.5957 


K  -  120, 


8(1) 

8(2) 

3.  901 

3.866 

58. C5 

58. 0C 

0.0124 

0.0165 

0.4681 

0.4677 

2.  1096 

2.  1026 

3.854 

• 

CO 

o 

1  ft 

49.61 

49.51 

0.0183 

0. 0244 

0.4001 

0.3953 

2.4539 

2.4434 

3.808 

3.745 

49.03 

48.87 

0.0239 

0.0319 

0.3954 

C. 394  1 

2.4685 

2.4563 

3.765 

3.686 

48.32 

48.  ce 

0.0294 

0.0392 

0.3896 

0.3877 

2.49  10 

2.477S 

3.723 

3.63C 

47.47 

47.15 

0.0347 

0.0463 

0.3828 

C.3802 

2.5216 

2.  50e4 

3.682 

3.576 

46.  50 

46.08 

0.0397 

0.053C 

0.1750 

0.3716 

2.5607 

2. 5485 

k  -  4,  p*  *  2/60 


-37- 


6(0) 


6.000 

63.  75 

g  -  3  0.0 

0.5141 

1.9450 


6.000 
57.0  2 

g  -  *  0.0 

0.4598 
2. 1746 


6.000 

58.06 

g  -  5  o.O 

0.4683 

2.1356 


6.  000 
58.89 

g  =  6  0.0 

0.4749 
2.  1058 


6.000 
59.50 
8  *  7  0.0 

0.4798 

2.0841 


6(1) 

6(2) 

5.836 

5.74C 

63.51 

63.36 

0.0135 

0.0216 

0.5122 

C.511C 

1.9  26  1 

1-9146 

5.765 

5.624 

56.55 

56.27 

0.0196 

0.0314 

0.4561 

0.4536 

2. 1497 

2.  1346 

5.697 

5.  515 

57.  31 

56.85 

0.0252 

0.0404 

0.4621 

0.4585 

2. 1092 

2.0930 

5.635 

5.415 

57.79 

57.13 

0.0304 

0.0486 

0.4660 

C.4607 

2.0804 

2.0646 

5.577 

5.  32  1 

58.02 

57.13 

0.0353 

0.0565 

0.4679 

C.4607 

2.0620 

2.0479 

6.000  5.  524  5.  23* 

59.90  58.00  56.85 

8  "  8  0-0  0.0397  0.0637 

0.4831  0.4677  C.458e 

2.0700  2.0531  2.042  1 


K  -  120,  k  -  6,  p*  -  3/60 


6(3) 


5.70  8 
63.31 
0.0244 
0.5106 
1.9108 


5.  57  6 
56.17 
0.0353 
0.4530 
2.1295 


5.454 

56.70 

0.0455 

0.457? 

2.0875 


5.  34  1 
56.91 
0.0549 
0.4590 
2.0592 


5.  236 
56.83 
0.0637 
0.4583 
2.0431 


5.  139 
56.47 
0.0718 
0.4554 
2.0383 


-38- 


8(0) 

8(1) 

8(2) 

6(3) 

6(4) 

8(5) 

10.000 

74.28 

9.718 
73.  86 

9.499 

73.53 

9.342 
73.3  0 

9.248 
73.  15 

9.217 
7  3.  11 

8*3  0.0  0.0141  0.0251  0.0329  0.0376  0.0392 

0.5991  0.5956  0.593C  0.5911  0.5900  0.5896 

1.6693  1.6552  1.  644  1  1.6361  1.6313  1.6297 


10.000  9.606  9.299  9.080  8.S48  8.904 

70.16  69.38  68.76  68.32  68.06  67.97 

0.0  0.0197  0.0351  0.0460  0.0526  0.0548 

0.5658  0.5595  C.5545  0.5510  0.5489  0.5482 

1.7673  1.7521  1.740  1  1.7313  1.7260  1.7243 


10.000  9.511  9.  129  8.855  8.690  8.636 

73.43  72.21  71.26  70.58  70.17  70.03 

8"  5  0.0  0.0245  0.0436  0.0573  0.0655  0.0682 

0.5922  0.5824  C.5747  0.5692  0.5659  0.5648 

1.6886  1.6752  1.6643  1.6564  1.6515  1.6499 


10.000  9.431  8.985  8.  664  8.471  6.406 

76.  14  74.43  73. 1C  72.14  71.57  71.37 

8-6  0.0  0.0284  0.0506  0.0668  0.0765  0.0797 

0.6140  C. 6002  0.5895  0.5818  0.5771  0.5756 

1.6287  1.6186  1.6103  1.6041  1.6002  1.5989 


10.000  9.  365  8.864  8.503  8.285  e.212 

78.31  76.09  74.35  73.10  72.34  72.09 

8-7  0.0  0.0317  0.0566  0.0749  0.0658  0.0894 

0.6315  0.6136  0.5996  0.5895  0.5834  0.5814 

1.5835  1.5780  1.  5732  1.5694  1.5670  1.5662 


10.000  9.  312  8.765  8.  368  8.  128  6.047 

79.99  77.24  75.07  73.51  72.57  72.26 

8-8  0.0  0.0344  0.0616  0.0816  0.0936  0.0977 

0.6451  0.6229  C.6054  0.5928  0.5851  0.5827 

1.5502  1.5502  1.5496  1.5491  1.54e6  1.5485 


K  -  120,  k  -  10,  p*  -  5/60 


39- 


£(M 


8(0)  8(1)  8(2)  8(3) 


16.000  15.556  15.17C  14.845  14.578 

88.69  88.02  87.44  86.96  86. 5b 

8*3  0.0  0.0139  0.Q259  0.0361  0.0444 

0.7152  0.7099  0.7052  0.7013  0.6580 

1.3981  1.3852  1.3813  1.3745  1.3689 


16.000  15.413  14.903  14.471  14.116 

87.33  86.  16  85.14  84.27  83.57 

8  “  4  0*0  0.0183  0.0343  0.0478  0.0589 

0.7043  0.6948  0.6866  0.6796  0.6739 

1.4199  1.4129  1.  4065  1.4011  1.3565 


16.000  15.312  14.711  14.  199  13.778 

92.59  90.87  89.38  88.11  87.06 

8*5  0.0  0.0215  C. 0403  0.0563  0.0694 

0.7467  0.7329  0.7208  0.7105  0.7C21 

1.3392  1.3352  1.3315  1.3282  1.3253 


16.000  15.245  14.575  14.009  13.537 

96.65  94.  39  92.41  90.72  39.33 

8*6  0.0  0.0236  0.0444  0.0622  0.C770 

0.7794  0.7612  0.7452  0.7316  0.7204 

t  •  28  30  1.2828  1.  2823  1.2818  1.  2812 


16.000  15.  205  14.497  13.  884  13.373 

99.65  96.86  94.42  92.33  90.60 

8*7  0.0  0.0248  0.047C  0.0661  0.08'>1 

0.8036  0.7812  0.7614  0.7446  0.7306 

1.2444  1.2483  1.2518  1.2542  1.2563 


16.000  15.107  14.453  13.810  13.769 

101.71  98.46  95.59  93.11  91.05 

8*8  0.0  0.0254  0.0483  0.0684  0.0853 

0.8203  0.7941  C. 7705  0.7509  0.7343 

1.2191  1.2274  1.  2345  1.2406  1.2456 


1  i 


g  a  3 


8(5)  6(6) 


14. 37  1  14. 222 

f 6.24  86.02 

0.0504  0.0555 

0.6955  0.6937 

1.3646  1.  3614 


6(7) 

6(8) 

14. 134 

14. 104 

85.89 

85.84 

0. 0583 

0.0593 

0.6927 

0.6923 

1. 3595 

1.  3589 

g  =  4 


13.840 

83.02 

0.0675 

0.6695 

1.3928 


13. 643 
82.63 
0.0737 
0.  6663 
1.390? 


13.524 

82.39 

0.0774 

0.6644 

1.3886 


13.485 

82.31 

0.0786 

0.6638 

1.3881 


g 


13.449 

86.25 

0.0797 

0.6956 

1.3230 


13.213 
85.67 
0. 0871 
0.6909 
1.  3213 


13.071 
85.32 
0. 0915 
0.6881 
1. 3203 


13.024 

85.20 

0.0930 

0.6871 

1.3200 


g  -  6 


13. 166 
88.  25 
0.0886 
0.7117 
1.2807 


12. 900 
87.47 
0.0969 
0.7054 
1.2803 


12.739 
87.00 
0. 1019 
0.7016 
1.2800 


12.685 
86.85 
0. 1036 
0.7004 
1.2799 


g 


12.969 
89.24 
0.0947 
0.7197 
1. 2579 


12.678 
88.27 
0.  1038 
0.7118 
1.  2590 


12.502 
87.68 
0. 1093 
0.7071 
1.  2596 


12.443 
87.49 
0.1112 
0.7055 
1. 259R 


g  -  8 


12.839 

89.43 

0.0988 

0.7212 

1.2495 


12. 526 
88.  27 
0.1085 
0.7118 
1.2523 


12.337 
87.56 
0.  1145 
0. 7062 
1.2540 


12.274 
87.  33 
0.1165 
0.7043 
1.2546 


K  *  120,  k  ■  16,  p*  ■  8/60  (continued) 


41- 


g  -  3 


g 


g 


g 


g 


g 


6.(0) 

6(1) 

6(2) 

6(3) 

6(4) 

8.000 

7.886 

7.804 

7.755 

7.739 

109.80 

109.63 

109. 5  1 

109.44 

109.41 

0.0 

0.0071 

0.0122 

0.0153 

0.016  3 

0.4500 

0.4493 

0. 4488 

0.4485 

0.4484 

2.2222 

2.2097 

2.2009 

2.1955 

2.  1937 

8.000 

7.833 

7.714 

7.642 

7.618 

97.  12 

96.78 

9  6.55 

96.40 

96.35 

0.0 

0.0104 

0.0179 

0.0224 

0.0239 

0.3980 

0.  3967 

0.  3957 

0.3951 

0. 3949 

2.5124 

2.4948 

2.482  1 

2.4745 

2.4719 

8.000 

7.783 

7.628 

7.535 

7.504 

92.22 

91.67 

91.  29 

91.05 

90.98 

0.0 

0.0136 

0.0233 

0.0291 

0.0310 

0.3779 

0.3757 

0. 374  1 

0.3732 

0.3728 

2.6460 

2.6255 

2.6108 

2.6019 

2. 5989 

8.000 

7.736 

7.547 

7.433 

7.395 

91.  10 

90.31 

89.74 

89.40 

89.29 

0.0 

0.0165 

0.0283 

0.0354 

0. 0378 

0.3734 

0.3701 

0. 3678 

0.3664 

0. 3659 

2.6783 

2.6572 

2.6419 

2.6326 

2.6294 

8.000 

7.691 

7.47  C 

7.337 

7.29? 

89.78 

88.70 

87.92 

87.46 

87.31 

0.0 

0.0193 

0.0331 

0.0414 

0.0442 

0.3680 

0.3635 

0.  3604 

0.3585 

0. 3578 

2.7177 

2.6977 

2.6831 

2.6741 

2.6711 

8.000 

7.649 

7.397 

7.24  6 

7.  195 

92.  26 

90.86 

09.85 

89.25 

89.05 

0.0 

0.0220 

0.0377 

0.0471 

0.0501 

0.3781 

0.3724 

0. 3682 

0.3658 

0. 3649 

2.6447 

2.6266 

2.6133 

2.6051 

2.6023 

K  -  240, 

k  •  8,  p* 

-  2/60 

42- 


8(0) 


12.000 

120.87 

0.0 

0.495a 

2.0188 


12.000 
111. 28 
0.0 

0.4561 

2.1927 


12.000 

109.20 

0.0 

0.4476 

2.2343 


12.000 
1 10.67 
0.0 

0.4536 

2.2048 


12.000 

111.68 

0.0 

0.4577 

2.1847 


12.000 

116.28 

0.0 

0.4765 

2.0985 


8(1) 

8(2) 

8(3) 

1 1.824 

11.679 

11.  567 

120.60 

120.39 

120.22 

0.0073 

0.0134 

0.0180 

0.4943 

0.4934 

0.4927 

2.0083 

1.9997 

1.9931 

11-747 

11.  539 

1 1.  378 

110.77 

110.36 

1 10.03 

0.0106 

0.0192 

0.0259 

0.4540 

0.4523 

0.4510 

2.1795 

2.1686 

2.1600 

11.676 

11.411 

11.205 

108. 40 

107.73 

107.22 

0.0135 

0.0245 

0.0331 

0.4442 

0.4415 

0.4394 

2.2207 

2.  2093 

2.2004 

11.613 

11.295 

11.048 

109.50 

1C8. 55 

107.8  1 

0.0161 

0.02S4 

0.0397 

0.4488 

0.4449 

0.4419 

2.1923 

2.iei? 

2.1734 

11.555 

11.190 

10.905 

110.  13 

108.85 

107.86 

0.0185 

O.033e 

0.0456 

0.4513 

0.4461 

0.4420 

2.  1746 

2.  1659 

2.1590 

11.  503 

11.095 

10.775 

114.29 

112.66 

111.39 

0.0207 

0.0377 

0.0510 

0.4684 

0.4617 

0.4565 

2.0908 

2.0841 

2.0788 

8(4) 

8(5) 

8(6) 

11.487 

11.439 

11 .423 

120.  10 

120.0  2 

120.00 

0.0214 

0.0234 

0.0240 

0. 4922 

0.4919 

0. 4918 

1.9883 

1.9854 

1.9844 

11.263 

11.  193 

11.170 

109.80 

109.67 

109.62 

0.0307 

0.0336 

0. 0346 

0.4500 

0.4494 

0.4493 

2. 1539 

2.  1502 

2. 1489 

11.058 

10.969 

10. 940 

106.85 

106.63 

106.56 

0.0393 

0.0430 

0.0442 

0.4379 

0.4370 

0.  4367 

2.  1939 

2.1900 

2.  1887 

10.871 

10.764 

10.729 

107.28 

106.97 

106.86 

0.0471 

0.0515 

0.0530 

0.4397 

0.4384 

0.4379 

2. 1673 

2.  16  37 

2.  1625 

• 

10.701 

10.578 

10.537 

107.15 

106.7  2 

106.58 

0.0541 

0.0592 

0.0610 

0.4  391 

0.4374 

0.4368 

2. 1540 

2.1509 

2.1499 

10.546 

10.408 

10. 362 

110.48 

109.93 

109.75 

0.0606 

0.0663 

0. 0682 

0.4528 

0.4505 

0.4498 

2.0748 

2.0724 

2.0716 

K  -  240,  k  -  12,  p*  -  3/60 


43- 


BCD 


£C0) 


20.000  19.706 
191.85  191.91 
0.0  0.0073 
0.5819  0.57S5 
1.7201  1.7128 


20.000  19.593 
137.93  136.62 
0.0  0.0102 
0.5632  0.5599 
1.7759  1.7678 


20.000  19.498 

139.76  138.51 
0.0  0.0125 
0.5728  0.5676 
1.7458  1.7396 


20.000  19.421 
144.93  143.  15 
0.0  0.0145 
0.5940  0.5869 
1.6836  1.6793 


20.000  19.358 
149.03  146.78 
0.0  0.0160 
0.6108  0.6016 
1.6373  1.6356 


20.000  19.309 
156.  14  153.  38 
0.0  0.0173 
0.6399  0.6286 
1.5627  1.5633 


K  -  240,  k 


£U)  £(3) 


19.443  19.  21  1 

141.01  140.67 

0.013S  0.0197 

C.577S  0.5765 

1.  7062  1.7004 


19.226  18.906 

135.89  135.24 

C . 01 93  0.0274 

0.  556  S  0.5543 
1.760S  1.7598 


19.048  18.  650 
137.38  136.39 
0.0238  0.0337 
0.563  C  0.5590 
1.7336  1.7286 


18.90C  18.439 
141.63  140.26 
0.0275  0.0390 
0.5805  0.5748 
1.6754  1.6718 


18.78C  18.266 

144.77  142.98 

0.0305  0.0433 

0.5933  0.5860 

1.  634  1  1.6325 


18.684  18.  127 
150.89  148.69 
0. 032  5  0.0468 
0.6184  0.6094 
1.563e  1.5642 


20,  p*  -  5/60 


£(4)  £C5) 


19.010  18.840 
140.37  140.  1  1 
0.0248  0.0290 
0.5753  0.5742 
1.6953  1.6910 


18.626  ie.390 
134.69  134.21 
0.0343  0.0403 
0.5520  0.5501 
1.7494  1.7448 


18.305  16.012 
135.53  134.80 
0.0424  0.0497 
0.5554  0.5525 
1.7241  1.7201 


18.038  17.697 
139.06  138.05 
0.0491  0.0576 
0.5699  0.5658 
1.6686  1.6658 


17.818  17.437 
141.43  140.  11 
0.0545  0.0641 
0.5796  0.5742 
1.6311  1.6299 


17.640  17.224 

146.77  145.14 
0.0590  0.0694 
0.6015  0.594e 
1.5644  1.5645 


44- 


£<7)  8(8) 


6(9)  £(10) 


8(6) 


18.700 
139.90 
0.0325 
0. 5734 
1.6874 


18.  196 
133.83 
0.0451 
0.5485 
1.  7410 


17.772 

134.20 

0.0557 

0.5500 

1.7169 


17.418 
137.22 
0.0645 
0.5624 
1.  6634 


17. 124 
139.03 
0.0719 
0. 5698 
1.6288 


16.882 
143.80 
0.0779 
0.5893 
1.  5645 


18.592 
139.74 
0.0352 
0.  5727 
1.6847 


18.046 
133.53 
0. 0489 
0.5472 
1.7381 


17.586 
13  3.74 
0.0604 
0. 5481 
1.7143 


17.201 
136.57 
0. 0700 
0.5597 
1.6616 


16.880 
138.  19 
0.0780 
0. 5664 
1.6279 


16.615 
142.76 
0. 0846 
0.5851 
1.5646 


18.515 

139.62 

0.0371 

0.5722 

1.6827 


17.938 

133.31 

0.0515 

0.5464 

1.7359 


17.452 

133.41 

0.0637 

0.5467 

1.7125 


17.045 
136.  11 
0.0739 
0.5578 
1.6603 


16.705 
1  37.59 
0.0824 
0.5639 
1.6273 


16.423 

142.01 

0.0894 

0.5820 

1.5645 


18.468 

139.55 

0.0383 

0.5719 

1.6815 


17.874 
133.  18 
0.0532 
0.5458 
1.7347 


17.37  2 
133.21 
0.0657 
0.5459 
1.7114 


16.951 

135.83 

0.0762 

0.5567 

1.6595 


16.600 

137.23 

0.0850 

0.5624 

1.6269 


16.308 
141.  56 
0.0923 
0.5802 

1.5645 


18.  453 
139.53 
0.0387 
0.5718 
1.6811 


17.852 
133.  14 
0.0537 
0.5457 
1.7342 


17.  345 
133.14 
0.0664 
0.5457 
1.7110 


16.920 

135.74 

0.0770 

0.5563 

1.6592 


16.  565 
137.11 
0.0859 
0.5619 
1.6268 


16.269 

141.41 

0.0933 

0.5796 

1.5645 


K  ■  240,  k  ■  20,  p*  ■  5/60  (continued) 


a(6) 


!<8) 


3(0)  3(2) 

32.000  31.  122 

170.57  169.25 

g  -  3  0.0  0.0137 

0.6901  0.6937 

1.4305  1.4218 


32.000  30.849 

171.62  169.32 

g  ■«  4  0.0  0.01 6C 

0.7034  0.6940 

1.4217  1.4151 


32.000  30.659 

177.91  174.56 

g  -  5  0.0  0.0210 

0.7292  0.7154 

1.3715  1.3685 


32.000  30.535 

185.79  161.40 

g  .  6  0.0  0.0229 

0.7614  0.7435 

1.3133  1.3143 


32.000  30.463 

191.56  186.20 

g  -  7  0.0  0.0240 

0.7851  0.7631 

1.2737  1.2789 


32.000  30.432 

199.50  193.26 

g  -  8  0.0  0.0245 

0.8176  0.7921 

1.2230  1.2316 


K  -  240,  k  -  32, 


£(4) 

30.  36  2  29.718  29.192 

168.11  167.15  166.36 

0.0256  0.0357  0.0439 

0. 689  C  0.6850  0.6818 

1.4142  1.4077  1.4023 


29.850  29.002  28.307 
167.33  165.64  164.25 
0.0336  0.0468  0.0577 
0.  6856  0.6788  0.6732 
1.4092  1.4041  1.3999 


29.486  28.490  27.669 

171.65  169.18  167.15 

0.0393  0.0548  0.0677 

C. 7035  0.6933  0.6850 

1.  3657  1.3632  1.3610 


29.245  28.  139  27.224 
177.57  174.31  171.62 
0.043C  0.0603  0.0746 
0.7277  0.7144  0.7034 
1.3149  1.3154  1.  3156 


29.095  27.912  26.927 
181.49  177.46  174.1? 
0. 045  4  0.0639  0.0793 
0.7436  0.7273  0.7137 
1.  2834  1.2871  1.  2501 


29.016  27.782  26.743 
187.75  183.00  179.06 
0.0466  0.0659  0.0821 
0.7694  0.7500  0.7338 
1.2391  1.2455  1.2508 


p*  -  8/60 


46- 


3(10)  3(12)  3(14)  3(16) 


g 


26.782 
165.74 
0.0503 
0.679  3 
1.3981 


28.490 
165.31 
0.0549 
0. 6775 
1.3951 


28.314 

165.04 

0.0576 

0.6764 

1.3933 


28.256 

164.95 

0.0585 

0.6760 

1.3927 


g 


27.766 
163.17 
0.0662 
0.6687 
1.  3964 


27.379 
162.40 
0.0722 
0.6656 
1.  3939 


27.146 

161.94 

0.0758 

0.6637 

1.3924 


27.069 
161. 79 
0.0771 
0.6631 
1.3919 


g 


27.028 

165.57 

0.0777 

0.6785 

1.3593 


26. 569 
164.  43 
0.0849 
0.6739 
1.3580 


26.292 

163.75 

0.0892 

0.6711 

1.3572 


26.200 
163.5  3 
0.0906 
0.6702 
1.3569 


g 


26.506 

169.52 

0.0858 

0.6948 

1.3158 


25.590 
168.02 
0.0939 
0.6886 
1.  3158 


25.679 
167.11 
0.0988 
0.6849 

1. 3159 


25.575 
166.81 
0.  1004 
0.6837 

1. 3159 


g 


26.  149 

171.53 
0.0914 
0.7030 
1.2925 


25. 588 
169.65 
0.1002 
0. 6953 
1,2941 


25.248 

168.53 
0. 1055 
0.6907 
1.2951 


25. 135 
168.15 
0. 1073 
0.6891 
1.2954 


g  -  8 


25,918 

175.96 

0.0950 

0.7212 

1.2549 


25. 320 
173.73 
0. 1044 
0.7120 
1. 2579 


24.  957 
172.38 
0.  1101 
0.7065 
1. 2597 


24.835 

171.93 

0.1119 

0.7046 

1.2603 


K  »  240,  k  •  32,  p*  *  8/60  (continued) 
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APPENDIX  C:  EXPECTED  LOSS  COMPARISON  FOR  p*  =»  .05 


The  following  pages  present  a  comparison  of  expected  loss,  EC(L),  in 
the  case  p*  *  k/K  ■  .05,  for  values  of  c  ■  1/12,...,  6/12.  The  entries 
here  were  obtained  from  the  data  in  Appendix  B.  Comparisons  of  E^(L)  for 
other  values  of  p*  may  also  be  obtained  from  the  data  in  Appendix  B. 
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K  =  60 

K  =  120 

K  -  240 
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.G063 
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.007 
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.011 
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.011® 

.013a 

.014 
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.013® 

.015® 

.016 
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.016® 

.018® 

.019 
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.020® 

.021 
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c 

1/12  (p*  = 

.05) 

& 

K  -  60 

K  -  120 

K  *  240 
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.014 

.013 
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.016® 

.020 

.019 
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.022® 

.025 

.025 
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.026® 

.030 

.029 
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a 

.031 

.035 

.034 
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.036 

.040 

.038 

E  (L)  for  c 
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*=  2/12  (p*  ■ 
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Entry  obtained  by  linear  interpolation. 
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£. 

K  «  60 

K  =  120 

K  =  240 

3 

•  0l7a 

•  018a 

.018 

4 

.025a 

•  026a 

.026 

5 

•  032a 

•  033a 

.033 

6 

•  040a 

.040® 

.040 

7 

.047a 

.046® 

.046 

8 

.053® 

.052a 

.051 

E  (L)  for  c  *  3/12  (p*  =  .05) 
c 


& 

K  *  60 

K  *  120 

K  »  240 

3 

.022 

.022 

.021 

4 

.033 

.032 

.031 

5 

.043 

.040 

.039 

6 

.053 

.049 

.047 

7 

.062 

.057 

.054 

8 

.071 

.064 

.061 

EC(L)  for  c 

-  4/12  (p*  = 

.05) 

Entry  obtained  by  linear  interpolation. 
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K  =  240 


£  K  =  60 
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.022a 

.023a 

.023 

4 

•  033a 

.  033a 

.033 

5 

•  043a 

.043a 

.043 

6 

•  053a 

a 

•  052a 

a 

.052 

7 
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•  060 

.059 

8 

•  07ia 

.  068a 
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Ec(L)  for  c 

-  5/12  (p*  = 

.05) 

£. 

K  -  60 

K  »  120 

K  *  240 

3 

•  022a 

.024 

.024 

4 

.033a 

.035 

.035 

5 

•  043a 

.046 

.044 

6 

.053® 

.055 

.054 

7 

.062® 

.064 

.061 

8 

.071a 

.072 

.068 

(L)  for  c  -  6/12  (p*  «  .05) 


Entry  obtained  by  linear  interpolation. 
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